Visual question answering from another perspective: CLEVR mental rotation tests

Different types of mental rotation tests have been used extensively in psychology to understand human visual reasoning and perception. Understanding what an object or scene would look like from another viewpoint is a challenging problem that made even harder if it must be performed single image. We explore controlled setting whereby questions are posed about the properties was observed viewpoint. To do this we created new version CLEVR dataset call Mental Rotation Tests (CLEVR-MRT). Using CLEVR-MRT examine standard methods, show how they fall short, then novel neural architectures involve inferring volumetric representations scene. These volumes can manipulated via camera-conditioned transformations answer question. efficacy different model variants through rigorous ablations demonstrate representations.